WHAT IS CLAIMED IS: 



1 . A system of managing data comprising: 

a plurality of map components, each map component having one or more ports for 
accepting data and for producing data and each map component 
encapsulating a particular dataflow pattern; 

compiler tools for organizing and linking said map components using said ports 
into a dataflow application; and 

an executor for creating and managing data communication among map 

components in the dataflow application and executing the dataflow 
application with data supplied to the system. 

2. The system of claim 1, the compiler including tools for visually creating 
composite components comprising other map components and tools for visually 
assembling map components into a dataflow application. 

3. The system of claim 1, at least one map component having properties determining 
map component design behavior. 

4. The system of claim 1, at least one map component having properties that affect 
map component execution behavior. 

5. The system of claim 1, at least one of the map components comprising a 
composite component encapsulating a particular dataflow pattern using other map 
components as subcomponents. 

6. The system of claim 1, at least one of the map components comprising a scalar 
map component to process a specific data transformation. 
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7. The system of claim 1 , at least one of said ports linked to transfer specific types of 
data. 

8. The system of claim 1, at least one of said ports initially defined as a generic port 
for processing generic types of data, said generic port being later synthesized to transfer a 
specific sub-type of data. 

9. The system of claim 1, at least one of said ports being composite, comprising a 
plurality of hierarchical ports. 

10. The system of claim 1, at least one of said ports supporting multi-valued null data 
tokens. 

11. The system of claim 1, at least one of said map components being encoded as an 
encrypted XML document. 

12. The system of claim 1, at least one of said map components being composite 
comprising a number of hierarchical dataflow graphs. 

13. The system of claim 1, the compiler operating to remove design time links 
between map components to produce a flat dataflow graph containing a plurality of map 
processes for execution. 

14. The system of claim 1, the executor operating to assign a thread to each map 
process for parallel execution. 

15. The system of claim 1, the compiler tools operating to perform syntactic and 
semantic analysis, type inference and validation. 
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16. A method of transforming data in parallel processing environments where map 
components are assembled visually into an integrated dataflow application by linking the 
map components and the integrated dataflow application is executed in parallel by 
recognizing the linked processes within the map components and allocating a thread to 
each process. 

17. The method of claim 16, wherein a plurality of map processes read data tokens 
from input ports and write data tokens to output ports. 

1 8. A method of managing data comprising: 

accessing a library of map components at least some of said map components 
constituting a specific data transformation and having input and output 
ports; 

assembling a dataflow application using map components from said library linked 
together using said ports; and 

executing the assembled dataflow application with source data. 

19. The method of claim 1 8, including imposing properties on the map components 
during assembly constraining the assemblage of the dataflow application. 

20. The method of claim 1 8, the map components including polymorphic ports which 
declare status as input and output ports during assemblage. 
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